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Abstract. We prove a theorem computing the number of solutions to a sys- 
tem of equations which is generic subject to the sparsity conditions embodied 
in a graph. We apply this theorem to games obeying graphical models and 
to extensive-form games. We define emergent- node tree structures as addi- 
tional structures which normal form games may have. We apply our theorem 
to games having such structures. We briefly discuss how emergent node tree 
structures relate to cooperative games. 

The set of Nash equilibria for a game with generic payoff functions is finite [2] . 
This implies that the set of totally mixed Nash equilibria for a game with generic 
payoff functions is also finite. These are the real solutions to a system of polynomial 
equations and inequalities. The complex solutions to the system of equations are 
called quasiequilibria. Thus, the set of totally mixed Nash equilibria is a subset 
of the set of quasiequilibria. In fact, the set of quasiequilibria is also finite in the 
most generic case, and its cardinality can be computed as a function of the numbers 
of pure strategies of the players. Thus, this is an upper bound on the number of 
totally mixed Nash equilibria. Even in a nongcneric case, as long as the set of 
quasiequilibria is finite, its cardinality will be bounded above by the number in the 
generic case. 

For the main theorem of this article, Theorem[IJ we hypothesize a set of technical 
conditions that a system of polynomial equations may satisfy, which are encoded in 
an associated graph, the polynomial graph, and we prove a formula describing the 
number of solutions in this case. We then show how to associate such a graph to 
three special classes of games. The first two are graphical games and extensive-form 
games. The last is games with emergent node tree structure, a new model for games 
in which the players can be hierarchically decomposed into groups. Usually such 
hierarchical decomposition is modelled by cooperative games, and we briefly discuss 
how our model is related to, yet differs from, the cooperative framework. 

1. Generic Number of Roots of a Sparse Polynomial System 

The following theorem tells us the number of O-dimensional complex roots (none 
of whose components are zero) of a system of polynomial equations which obeys 
certain sparsity conditions and is otherwise generic. Our formulation of this theo- 
rem is motivated by the applications to game theory which follow, although such 
polynomial systems may arise in other contexts. 
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Theorem 1. Suppose that < d G N and that we are given a partition {1, . . . , d} = 
IL =1 T of {1, ... ,d}. Write di = [Tj|. Suppose further that we are given a directed 
graph G, the polynomial graph, on d vertices, denoted vi, . . . , Vd, without self-loops 
and with the property that for any Vj and Ti, if there is some k G T such that there 
is an edge from Vj to Vk in G, then for every k G Ti there is an edge from Vj to Vk 
in G. Let 

/l(0l, . . . ,<7 d ) =0, 

f 2 {o-i,...,o-d) =0, 
fd{o-\,...,o- d ) =0 

be a system £?J) of d polynomial equations in d variables <7i, . . . , a d with the following 
properties: 

(1) All monomials occuring in the ft 's are squarefree. 

(2) If (Tj, (Tfe G Ti with j 7^ k then o~j and o~k do not both occur in any monomial 
of any of the fi 's. 

(3) If there is no edge from Vj to Vk in G then the variable o~k does not occur 
in fj . 

Thus, the equations are multilinear, and they are linear over the variables from each 
Ti . Construct a d x d matrix M as follows: If variable o~k occurs in the polynomial 
fj, with Ti the subset containing Vk, then 

1 

otherwise Mjk = 0. If the system {Ip is 0- dimensional, then the number of its solu- 
tions in (C*) d (i.e. such that o~k ^ for all k) is bounded above by the permanent 
of M, and is equal to the permanent of M for generic coefficients. 

Proof. Without loss of generality, assume 

{i-l i-l i-l ~) 

i+j2 di > 2+ 12 di '---' di+ J2 di }' 
i=i i=i i=i ) 

that is, that the TVs are contiguous. 

Let ctjj = 1 if there is an edge in G from Vj to Vk for k G Tj , and atj = otherwise. 
Then the Newton polytope Pj of fj is the Cartesian product P\j x P^j x • • ■ x P^j , 
where Ty is the convex hull of the scaled coordinate vectors {a^ek \ k G T} and 
the origin. For i with a,j = 1, Pij is the dj-dimensional unit simplex, and for i 
with a.ij = 0, Pij degenerates to the dj-dimensional origin (which is a 0-dimensional 
simplex) . By the Bernstein-Kouchnirenko Theorem [T] [J] , it suffices to show that 
the mixed volume of the polytopes Pi, . . . , P d is given by the permanent of M. 

Let Qj = XiPi + ■■■ + XjPj, where + denotes Minkowski addition and the 
scale factors Ai,...,Aj are parameters. We show by induction on j that Qj = 
Qij x Q2j x ■ ■ • x QNj, where Qij is the convex hull of 

{(a,iAi + a l2 X 2 H h a lj Xj)e k \ k G T} 

and the origin. (If OjiAi + aj2A2 + • • • + dij\j = then Qij degenerates to the 
origin.) The base case follows from our characterization of Pj above. Now consider 
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the Minkowski sum of Qj = Qij X ■ ■ ■ X Qni and \j+\Pj+\ = (Aj+ipUj+i)) x • • • x 
(Aj+iPjv(j+i))- It follows from the definition of Minkowski sum that this is (Qij + 
Aj+i-Pifj+i)) x ••• x (Qnj + Aj+iPjv(j+i))i and (using the induction hypothesis) 
that each factor Qy + A 3 -+iP,Yj_|_i) is equal to the convex hull of 

{(ctiiAi + a i2 A 2 H h A, + a^ J+ ^e j+ i)e k \ k e T t } 

and the origin. 

The (^-dimensional volume of the ^-dimensional unit simplex scaled by A in 
each dimension is 

A*_ 
(*)!• 

We are interested in the c?-dimcnsional volume of Qd- If an = a-ii = ■ ■ ■ = a ic i = 
for some i, then this volume vanishes, and hence the mixed volume also vanishes. 
In this case the fcth column of the matrix M will be all zeroes for any k € T il so 
the permanent of M also vanishes, and the theorem holds. So assume that for each 
i, there is some j with aij = 1. Then the volume of Qd is 

N 



n 



(aaAi j h aid^d) ' 

dA 



Let (gjk) be the adjacency matrix of G, that is, gjk = 1 if there is an edge in G 
from Vj to Vk and gjk = otherwise. Then = gjk for all fc € Tj. So the volume 
of is 

rifc=i (gifcAi j — h gdfcAd) 



The mixed volume of Pi, . . . , Pd is the coefficient of A1A2 • • • in the above expres- 
sion, which is the permanent of (gjk) divided by YiiLi di-- 

It remains to show that the permanent of M is the permanent of (gjk) divided by 
YliLi d%- Note that Mjf. ^ exactly when gjk ^ 0. We induct on N. For the base 
case, g?i = d, and each nonzero entry of M is (1/c?!) 1 ^. A term in the permanent 
of M is the product of d entries from M, so if it is nonzero it is 1/dl. Thus the 
permanent of M is l/d\ times the permanent of (gjk), as required. Now partition 
the matrix M and the matrix (gjk) into two vertical bands corresponding to the 
subsets U^T 1 ! 1 , and Tjv. The permanent can be computed as the sum of a term for 
each choice of rows 1 < ji < ■ ■ ■ < jd N < d: compute the (d — djv) x (d — rfyv) 
subpermanent of the left band obtained by crossing out those rows, compute the 
rf^v x d]y subpermanent of the right band corresponding to those rows, and multiply 
them together. By the inductive hypothesis, the left subpermanent of M is the left 
subpermanent of (gjk) divided by n^i 1 ^i'- For the right subpermanent, every row 
is either all nonzero or all zero. If any row is all zero, both right subpermanents 
vanish. If every entry is nonzero, then all the entries are the same: gjk = 1 and 

M jk = (l/d N *-) 1/dN - The right subpermanent of M is d N \ ((l/d N \) 1,dN ^ dN = 1, 
and the right subpermanent of (gjk) is d/v!. So the whole term for M is the whole 
term for (gjk) divided by Yl i=1 dA. □ 

We note that if the coefficients are generic subject to the conditions given in 
Theorem [TJ all the solutions to the system will lie in the torus (C*) d . In what 



4 



RUCHIRA S. DATTA 



follows we will refer to "the number of solutions in the torus (C*) d " as "the number 
of solutions" by abuse of language. 

Corollary 2. Convert the directed graph G of Theorem^ into a bipartite graph on 
2d vertices, with the source of every edge on the left side and the target of every 
edge on the right side. If the system in Theorem]]] is O-dimensional with generic 
coefficients, then it has a solution if and only if this bipartite graph has a perfect 
matching. 

Proof. From the proof of Theorem[TJ we see that the number of solutions is nonzero 
if and only if the permanent of the adjacency matrix is nonzero. It is a well-known 
fact that this is equivalent to the existence of a perfect matching: any permutation 
7r which contributes a nonvanishing term IljLi 9jn{j) t° the permanent corresponds 
to a perfect matching, where vertex j on the left is matched to vertex 7r(j) on the 
right. □ 

In fact, we could have used the bipartite graph in Theorem [TJ However, we 
defined the polynomial graph to be the directed graph to remain consistent with 
the usual definition of graphical models of games. 

Corollary 3. If the system in Theorem^ is O-dimensional and has a solution, then 
every node in the graph G lies on a directed cycle. 

Proof. As in the proof of the previous corollary, a permutation tt must exist such 
that j has an edge to ir(j) for every j = l,...,d. This permutation can be expressed 
as a product of disjoint cycles. Each node lies in one of these cycles, and a cycle of 
the permutation corresponds to a directed cycle in the graph. □ 

We should note carefully that the Bernstein-Kouchnirenko theorem gives the 
number of solutions to a O-dimensional polynomial system. So when the number 
given by that theorem — in particular, the permanent of the matrix in Theorem 
[T] — vanishes, either the polynomial system has no solution, or its solution set has 
positive dimension. 

Note that the conditions on G imply that the matrix M has a di x di block of 
zeroes along its diagonal for i = 1, . . . , N. This is because G has no self-loops, and 
if it had an edge from an element Vj of Tj to any other element Vk of Tj , then there 
would have to be an edge from Vj to every element of Tj including itself. 

2. Finite Games 

In the remainder of this article, we apply Theorem [1] to game theory in a few 
different contexts. We now introduce the notation we will need from game theory. 
The concepts we describe in this section can be found in a standard game theory 
text such as \7\. However, in some cases we use simplified notation for the restricted 
situations we will consider. 

Game theory is the study of strategic interaction. Such interaction takes place 
between multiple agents in a single setting, or environment. An agent is an entity 
which can receive information about the state of the environment (including itself 
and other agents), take actions which may alter that state, and express preferences 
among the various possible states. These preferences are encoded for each agent by 
a utility function, a mapping from the set of all states to K. Its value for a particular 
state is the utility of that state for the agent. The agent prefers one state to another 
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if its utility is greater, and is indifferent between them if their utilities are equal|_j 
Changes in the state of the environment may also occur spontaneously (i.e., not 
due to the actions of any of the agents). A strategy is a (possibly stochastic) rule 
for an agent to choose an action at every point when the agent may act, given 
the available information. A rational agent is one whose strategy maximizes its 
expected utility under the circumstances. 

We will restrict attention to games which take place in a finite number of time 
steps between a finite number of agents, each of which has a finite number of 
possible actions. The agents are called players, and whenever they take an action 
they are said to move. A spontaneous change in the state of the environment is 
called a move by nature. The game is over when no player (including nature) has 
any possible actions. The state of the environment at such a terminal stage is 
called an outcome. Generally preferences arc specified only over outcomes, not at 
intermediate stages of the game. 

The first type of game we will consider is the normal-form game. In a normal- 
form game, there is only one time step, at which all the players move simultaneously. 
We denote the set of players by / = {1, . . . , N}. The actions a player can take are 
called pure strategies. We associate to the players finite disjoint sets of pure strate- 
gies Si, ... , Sn- For each i let di = \Si\ — 1. We write the set Si as {sio, . . . , Si^}. 
We write S = Yliel Game play consists of the collective choice of an element of 
S by the players: each player i moves by choosing an element of Si. We identify 
S as the set of possible outcomes. We denote by itj(s) the utility for player i of 
the outcome s £ S. Thus, the game is completely specified by the number N of 
players, the sets Si of pure strategies, and the utility functions (or payoff functions) 
Ui'. S i — > M. 

A player may move stochastically rather than deterministically. In that case 
the player is said to execute a mixed strategy. The mixed strategy specifies the 
probability with which the player chooses each possible action. The set E, of mixed 
strategies of player i is the set of all functions <Xj : Si i— ► [0, 1] with . gS . 0"j(sy) = 
1. That is, it is the tZj-dimensional probability simplex. We write E = Yiiei ^ 
element a of E, which specifies the strategies executed by all the players, is called 
a strategy profile. If the players execute the strategy profile a, then the probability 
of outcome s is <r(s) = YliLi a i( s i)- The expected utility for player i of the strategy 
profile a is given by multilincarity as u;(<j) = J2sts u i(s)a(s). 

When considering how agent i should behave, it will be convenient to separate out 
i's own strategy, over which i has control, from the strategies of all the other players. 
We write E_j = ano - we wl "ite d-i for the image of a G E under the 

projection 7r_i from E onto E_,-. By abuse of notation, we write Ui(ji, o~i) for the 
ith player's expected payoff from the strategy a whose zth component is Tj and 
whose other components are defined by 7r_;(cr) = er_i. 



Instead of specifying the utility of each state for each agent, one might specify the change 
in utility, or marginal utility, which accrues to each agent upon each transition between states. 
Clearly any utility function induces a marginal utility function, but unless one imposes additional 
conditions a marginal utility function may not induce a utility function. Such a marginal utility 
function, which one might call intransitive, could still be a useful model of reality. For example, 
one wouldn't necessarily feel the same about being laid off and then immediately rehired as if 
one had simply continued in the same position. However, we will not consider such intransitive 
marginal utility functions any further. 
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We assume perfect information: each player knows the complete specification 
of the game, knows that every player knows, knows that every player knows that 
every player knows, ad infinitum. That is, the specification of the game is common 
knowledge. Under these circumstances, what is rational behavior? In his landmark 
paper [6J, John Nash answered this question in terms of what is now called best 
response. A best response of player i to the strategy profile a is a mixed strategy 
cr* such that Ui(a*,cr-i) > u^cr^, cr_j) for any other mixed strategy o~[ of player i. 
That is, given that all the other players execute the strategy profile cr_;, the mixed 
strategy a* maximizes player i's expected utility. A Nash equilibrium is a strategy 
profile which is a best response to itself for all the players. That is, it is a strategy 
profile a* such that for each player i, we have Ui(cr*) > Uj(o^, cr*^) for every other 
mixed strategy a[ of player i. Nash proved that such an equilibrium always exists. 

How can we compute the Nash equilibria of a given game? We need to search the 
set £ of strategy profiles, which is a polytope: the product of probability simpliccs. 
We can decompose the problem by stratifying this polytope: first we look for Nash 
equilibria in its interior, then in the interiors of its facets, then in the interiors of 
the facets of those facets, and so forth, until finally we look for Nash equilibria at 
the vertices of the polytope (that is, pure strategy Nash equilibria). A strategy 
profile a lies in the interior of this polytope if <Ji(sij) > for every € Si, for 
every i. Such a strategy profile is called totally mixed. Note that a totally mixed 
Nash equilibrium need not exist. 

So we concentrate our attention on the totally mixed Nash equilibria. We observe 
that for a totally mixed strategy profile cr to be a Nash equilibrium, it is necessary 
and sufficient that for each player i we have Ui(sij, cr_,) = Ui(sik, o~-i) for any pure 
strategies Sjj , Si k 6 £, . These equations are called the indifference equations for 
player i. The sufficiency is clear. For the necessity, suppose to the contrary that 
u^s^^a-i) > Ui(s ik ,cr-i). Define a[ by 

!o-i(sij) + ai(siic), l=j 
0, I = k 

o-i(su), otherwise 

Then since Ti{sik) > 0, we have 

Uiia'^a-i) = Ui{a) + ai(s ik ) (uj(s y , <7_j) - Ui(s ik , cr_;)) > Ui(a), 
a contradiction. 

So we have a system of J2iLi di equations, Uj(s.y, cr_j) = Uj(sjo,c_i) for j = 
1, . . . , di, for i = 1, . . . , N, in y ■_ 1 d, unknowns o~i(sij) for j = 1, . . . , dj, for i = 
1, . . . , N. (Here we have dehomogenized, that is, we have eliminated CTi(sio) by sub- 
stituting 1 — YljLi cr i( s u))- What we are equating are the expressions u.i(sij, O-i) = 
J2s-.es-, u i( s i]i s ~i) (7 i( s i) ■ ■ 1 (si-i)ci+i{s i+1 ) ■ ■ ■a N (s N ), which arc multilin- 
ear polynomials whose coefficients are the real numbers u;(s). The (possibly com- 
plex) roots of this system are called quasiequilibria, and those roots which are totally 
mixed strategy profiles (that is, which are real with ai(sij) > and J2j=i <7 i( s ij) < 
1) are the totally mixed Nash equilibria. 

Now we see how Theorem [T] applies to normal-form games. In this case, each 
Ti corresponds to the set of strategies of player i. The blocks of zeroes along the 
diagonal imply that a player's expected payoffs from their own pure strategies do 
not depend on the probabilities they have assigned to their own pure strategies, so 
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these polynomial systems do indeed correspond to the equations for totally mixed 
Nash equilibria of games. 

Corollary 4. Consider a normal form game between players I = {1, . . . , N} with 
pure strategy sets Si for each i and generic utility functions Ui : Yii£i - *• 
Construct a graph G with nodes W i£l {Si — {sio}) such that there is an edge from 
Sik to Sji in G if and only if i ^ j. Let the variable corresponding to Sik be o~i(sik) 
and the equation corresponding to so- be the indifference equation Ui(sik,cr—i) = 
Ui(sio,o~-i). Then this system of equations obeys the conditions of Theorem^ so 
the number of solutions in the generic case is given by that theorem. 

This special case was proved as Theorem 2 in [5] , so our Theorem Q] is a gener- 
alization of that theorem. 

3. Graphical Games 



Kearns, Littman, and Singh [3] defined the concept of graphical games, or games 
obeying graphical models. (That paper considers undirected graphs, but the ex- 
tension to directed graphs which wc will use is straightforward.) A game between 
players 1,...,N obeys a directed graphical model, if the payoffs to player i\ only 
depend on the actions of those players ii ^ i\ for which there is an edge from i\ to 
«2 in the graphical model. 

Our theorem applies in particular to graphical games. As in Corollary 01 we 
take the pure strategy sets Si to be the sets Tj of Theorem [TJ Given a polynomial 
graph G as in Theorem [TJ we draw an edge from i\ to i2 in the graphical model if 
there is any j £ with edges to the vertices in T, 2 in the polynomial graph G. 
The polynomial graph G may not represent the most generic case of the graphical 
model, however. If we are given a graphical model, then to construct its polynomial 
graph G, for any edge from i\ to i%, we draw edges in G from every vertex j G 
to every vertex in Ti 2 . 

Corollary 5. Suppose a normal form game between players I = 1, . . . , N with pure 
strategy sets Si for each i and utility functions Ui : Yiiel ~ * ^ obeys a directed 
graphical model 7 with nodes 1, . . . , N. Construct a graph G with nodes Yl ieI Si 
such that there is an edge from Sik to Sji in G if and only if there is an edge from 
i to j in 7. Then the system of equations defining the quasiequilibria of G satisfies 
the hypotheses of Theorem^ so the number of such quasiequilibria in the generic 
case is given by the permanental formula. 

For example, consider a game with 4 players, each with 3 pure strategies. Gener- 
ically, such a game has 
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Figure 1 . Graphical game 

But suppose now that game obeys a graphical model as in Figure 3.1. The nodes 
in the graphical model refer to the players, and the edges specify that the payoff 
to the source player depends on the actions of the target player. For brevity, write 
a = oi(sii), b = a 2 (s 12 ), c = a 2 (s 21 ), d = <J 2 (s 22 ), e = cr 3 (s 31 ), / = cr 3 (s 32 ), 
g = 04(541), and h = (74(542). Since the payoff to player 1 depends only on the 
actions of player 2, equating the payoff to player 1 from pure strategies sio and sn 
gives 

Ul(siO> S20, •)0'2(S20) + Wi(si , S 2 1, •)<7 2 (s 2 l) + Ul(siO, S 22 , •)cr 2 (s 22 ) 

= ui(su, S20, •)o _ 2 (s 20 ) + Ui(su, s 2 i, •)o - 2 (s 2 i) + ui(su, s 22 , •)er 2 (.s 22 ) 

or 

(ui(sn, s 20 , •) - ui(sio, S20, •)) (1 - c - d)+ 

+ (ui(su, 821, •) - ui(sio, S21, •)) c + (ui(su, s 22 , •) - ui(si , S22, •)) d = 0. 

Thus for player 1 we have two equations of the form 

•c+«d+« = 0, 
for player 2 we have two equations of the form 

+ + . = 0, 
for player 3 we have two equations of the form 

•g + mh + * = 0, 
and for player 4 we have two equations of the form 

•a + *b+» = 0. 

Then the associated polynomial graph is depicted in Figure [3J The equation asso- 
ciated with the node labelled la equates the payoffs to player 1 from choosing sn 
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quasiequilibrium. Indeed, this will always be the case for a graphical model which 
is a directed cycle, where each player has the same number of pure strategies. The 
reason is that the indifference equations in this case are linear, as we saw in this 
example. 

The polynomial graph G as defined in Thcorcm[T]contains more refined informa- 
tion than the graphical model. The partition into the Tj's also can be more refined 
than the partition of the set of all pure strategies into the sets of pure strategies 
for each player. Next we will see an example of such a refinement when considering 
the reduction of extensive-form games to normal-form, where actions correspond to 
branches of the game tree. 
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4. Extensive-Form Games 

Now we consider finite horizon extensive-form games. (See for example [7], Chap- 
ter 6.) Such a game takes place in a finite number of time steps, at each of which 
only a single player (possibly nature) may move. (Which player moves, and what 
actions the player is allowed to take, may depend on what moves were made previ- 
ously.) Such a game is completely specified as follows. We specify a set of players 
/ = {f , . . . , N}, and we specify a game tree T: a finitely branching tree of finite 
depth in which each non-leaf node is labelled by a number in 0, . . . , N, each leaf is 
labelled by an iV-tuplc of real numbers, and each branch emanating from a (non- 
leaf) node labelled is assigned a positive real weight, so that the total weight 
emanating from such a node is 1. (We consider the branches of this tree to be 
directed away from the root.) 

Game play proceeds as follows. Each node of the tree represents a state of 
the environment. At each time step, if we are at a non-leaf node labelled by i in 
1, . . . , N, then player i acts by choosing one of the branches emanating from that 
node. Then the environment undergoes the transition to the node at the end of 
that branch, and we advance to the next time step. If we are at a non-leaf node 
labelled by 0, then the environment instead makes a random transition along one 
of the branches emanating from that node; the probability of each branch is given 
by its weight. If we arc at a leaf node A labelled by (iti(A), . . . , uat(A)), then the 
game is over, and each player i accrues utility Ui(X). Thus, the leaf nodes are the 
outcomes of the game. 

Unless otherwise specified, wc will assume perfect information. Not only do all 
players have common knowledge of the specification of the game, but whenever a 
player is about to move, that player knows what moves have been made by all the 
other players (including nature) up to that point. 

Every extensive-form game is equivalent to a normal-form game. For each node 
v of the game tree, we write E(v) for the set of edges emanating from v. Then the 
set of pure strategies of player i is 

s l= n 

label(i/) = i 

Given a pure strategy profile s £ S ~ Yiiei we can compute the probability of 
each leaf node A of the game tree. A unique path vqV\ ■ ■ ■ v m = A leads from the 
root vq of T to A. Then Pr[A|s] = Iljlo 1 Pr^j ~^ l/ j+i\ s \i where 

{1, Vj is labelled by i E / and Sj„. = (vj — > Vj + i) 

0, Vj is labelled by i E / and Si v . ^ (vj — » z/j+i) 

wt(vj — > i/j+i), Vj is labelled by 

and so the utility functions of the normal-form game are given by 

Ui (s) = u<(A)Pr[A|a]. 

AGT 
Aleaf 

Wc note that the game specification implies certain equalities among the numbers 
Ui(s). If we consider the set of normal-form games with a fixed set of players / and 
outcomes S to be a linear space with basis {ui(s) : s E S}, then the extensive-form 
games with the same set of players I and a fixed game tree having S as the set 
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of outcomes lie in a linear subspace of this space, given by these equalities. Let A 
be the set of non-leaf nodes of the tree which are not labelled by 0. Then we can 
identify S with Jl^eA E{v). For any s G S and v £ A, we write s v = Si v , where i is 
the label of v. Suppose v G .4 is an ancestor of fi S .4. Then v lias a unique child 
a that is also an ancestor of fi (possibly /i itself). Let [3 be any other child of v. If 
s, s' G A with s v = (y — ► fj) and 



for some edge e G E(/j,), then «j(s) = Uj(s'). This is because Pr[A|s] = Pr[A|,s'] = 
unless A is a descendant of [3 or A is not a descendant of v, and in either case A 
cannot be a descendant of /i. In short, the node is never reached, so it doesn't 
matter which action is chosen there. 

If different players act at v and /i, then there is no way to eliminate this redun- 
dancy, but when the same player i acts at v and [i, we can do so. In this case we 
replace all the pure strategies which are forced to be equal by a single pure strategy, 
called a reduced pure strategy. See for example [7], p. 94. 

We note that after iterated elimination of strictly dominated pure strategies, for 
any node all of whose children are leaves, the payoffs to the player who acts at 
that node must be equal at all these child leaves. If nature acts at such a node v 
whose children are leaves Ai, . . . , Afc, then we can replace v by a leaf with utilities 
u i{ v ) — X/(=i w t(f — > Az)ui(A) for each i 6 7. So we assume nature never acts at 
such nodes. 

For extensive-form games, the equilibrium concept can be refined. Each subtree 
of the game tree induces a new extensive-form game, called a subgame. Each pure 
strategy of the original game induces a pure strategy of each subgame by restriction 
to that subtree, and thus each strategy profile of the original game induces a strategy 
profile of each subgame. A strategy profile is a subgame perfect Nash equilibrium 
of an extensive-form game if it induces a Nash equilibrium of each subgame. 

We can find a subgame perfect pure strategy Nash equilibrium by backwards 
induction. We construct the pure strategy profile as follows. We perform iterated 
elimination of strictly dominated strategics. Then at each node all of whose children 
are leaves, we choose one leaf (recall that the payoffs of all leaves for the player who 
acts at that node will be the same). We assign this branch to the corresponding 
component of the pure strategy profile, replace this node by this leaf, and repeat 
the procedure on the resulting subtree. 

We begin our analysis of totally mixed Nash equilibria of extensive form games 
by noting the following: 

Theorem 6. All totally mixed Nash equilibria of an extensive form game are sub- 
game perfect. 

Proof. Let a be a totally mixed Nash equilibrium of an extensive form game with 
N players defined by game tree T. Note that the strategy profile induced by a on 
every subgame is also totally mixed. Let v be a non-leaf node of T. Let a be the 
strategy profile induced by a in the subgame induced by v. Let Sj and tj be pure 
strategies of player j in this subgame. Choose an action for j at each node \i that 
is not a descendant of v where j acts, such that if fi is an ancestor of v then j 
chooses the branch leading towards u, and use this choice to extend Sj and tj to 




v = \i 
otherwise 
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pure strategies Sj and tj of player j in the original game. (So, Sj and tj specify the 
same actions outside the subtree.) Let vq . . . v m = v be the unique path from the 
root vq of T to v. We have Uj(sj, <J-j) = Uj(tj, c-j). Let L be the set of all leaves 
of T under v and L' be the set of all other leaves. Then 

u j ( s j > = E xeL u j ( A ) Pr [ A l ( s j > a ~] )] + Eag l' u j ( A ) Pr I A I ( S J > )] 

= Ea £ l%( A ) Pr[A|(*i,o--i)]+EA 6 L''*iWP^I(*i»o--i)] 
since Sj and choose the same actions outside the subtree. Thus 

(1) «iWPr[A|(a J -,o--i)] = E «jWPt[A|fe,<r- 3 -)]. 

Aei Aei 

Furthermore, for any A £ L, we have 

m— 1 

Pr[A|(sj,o-_j)] = PrlAKS,-,^.)] ijPr^-^i/fc+xKa^o--,-)] 

m— 1 

= Pr[A|(Si,cr-.,-)] J] Pr K ^ "fc+l|(*j,o--i)]- 

fc=0 

Noting that the common factor Ofc^c) 1 Prt^A; — * Vk+i\(tj, m equation |TJ is 

positive by our choice of Sj , tj and because a is totally mixed, we have that 

Uj(sj,a-j) = ^u j (X)Pr[\\(s j ,d-- j )] 
xeL 

= ^ Ui (A)Pr[A| (tj,^)] 
xeL 

= Ujitj'V-j)- 

Thus a is a (totally mixed) Nash equilibrium of the subgame induced by v. □ 

In light of this observation, the divide-and-conquer approach to finding all Nash 
equilibria of a normal form game can be modified in the spirit of backwards induc- 
tion to finding all subgame perfect equilibria (including mixed ones) of an extensive 
form game. Recall that in a normal form game, we would consider subproblems in 
which one pure strategy of one player i was removed. Now we instead consider sub- 
problems in which, for some edge v — ► (i where i acts at is, we delete that edge and 
the entire subtree below /i. We compute the normal form for the game described by 
this pruned tree and recursively find all its subgame perfect equilibria. Each such 
equilibrium a induces an equilibrium a in the subgame under v in the pruned tree. 
To check whether a is an equilibrium of the original game, we recursively compute 
all the equilibria of the subgame under \x (where % does not act), and check that for 
each such equilibrium r, we have u.i(a) > Ui(r). 

We saw during the above proof that for a totally mixed strategy profile <r, the 
equations Uj(sj,<T-j) = Uj(tj,a-j) for all pure strategies Sj,tj of j imply the cor- 
responding equations for each subtree. The converse implication also clearly holds. 

We will now associate a polynomial graph to a system of equations for the 
quasiequilibria of an extensive-form game, so that we can apply Theorem [TJ For 
each node in the game tree where a player acts, we will have a variable for every 
edge emanating from that node except one distinguished edge. This is because the 
sum of the probabilities of choosing each of those edges must be 1, so we eliminate 
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one variable. Thus, we compare the payoffs between choosing the distinguished 
edge and choosing any other edge. The equations will be indifference equations for 
subgames of the extensive-form game. 

Theorem 7. The set of quasiequilibria of a generic extensive-form game is either 
empty or has positive dimension. 

Proof. Consider an extensive form game with players I = 1, . . . , N and game tree 
T. Let A be the set of non-leaf nodes in T not labelled by 0. For each v G A, let 
E{y) be the set of edges emanating from v. For each v G A, let i be the player 
which acts at v and pick an element G E(v). Let d = X^eA — 1| and 

partition d as U„ gj 4 {E(v) — {e^}). Define a directed graph G on a set of d vertices 



(J K | e G - {e jF }} 

i/6A 



as follows: there is an edge from n e with e G -E(f) — {e«/} to n e i with e' 6 -E(a*) — 
{ej^} if i ^ j, is an ancestor of /x, either e or lies on the path from v to n, and 
if i acts at some node k between v and /i, then the edge lies on the path from 
v to fi. We will define a system of equations equivalent to the equations defining 
totally mixed Nash equilibria of the extensive form game and satisfying conditions 
1 to 3 of ThcorcmQ] The polynomial graph G is acyclic, so Corollary [3] implies our 
assertion. 

First we must state what the equations are. Fix a node v G A and let i be the 
player which acts at v. Then — 1 equations refer to the subgame induced by 

this node. For each e S E(v), define the pure strategy s; e of i in this subgame by 
Sieiv) = e and Sj e (/x) = for any node fj, below v where i acts. Writing a for the 
strategy profile induced by a in the subgame under v, the — 1 equations are 

the equations Ui(s e ,a-i) = Ui(s eil/ ,5-i) for e G E{v) — {e^}. In these equations 
we eliminated o~(ej fl ) for every fj, below v where i does not act, by substituting 

1 - EeeS(/*)-e {3> } a A e ) for 

These are some of the indifference equations for the subtree below v, which as we 
saw in the previous theorem are implied by the indifference equations for the whole 
tree. We show by induction that these equations also imply all the indifference 
equations for the subtree below v. (Thus we will have the indifference equations 
for every subtree, and hence the whole tree, i.e., the original game.) Firstly, i is 
indifferent between all i's pure strategies in the subgame below v, because although 
we fixed i's pure strategies at nodes y, below v where i acts to be e,^, we also have 
that i is indifferent between i's pure strategies in the subgame below (i by the 
induction hypothesis. Secondly, consider any other player j. Let fi±, . . . , /U m be the 
nodes below v where j acts, such that j does not act at any node between v and 

for any k. Let Sj,tj be pure strategies of j in the subgame below v, and write 
Sj, , tj k for the respective induced pure strategies of j in the subgame below /Lt^. So 
Sj = {s~j 1 , . . . , Sj ) and tj = {tj 1 , . . . , tj ). Write the set L of leaves below v as 
L = L U UfcLi Lk, where L Q is the set of leaves A such that j does not act between 
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v and A and Lk is the set of leaves below fj,k for k = 1, . . . , m. Then 

A6L 

m 

AeL k=l \€L k 

m 

= u j( X \ d -j) + ^2 u i( A l*ife' 5 '-j) 

AeL k=l\GL k 

since for each k, X^AeL fc u j(^l s "j'fe' ~ Eagl,, u j( X \tjk> ^—i) by the induction 
hypothesis. 

We can already see that the set of solutions to these equations, if nonempty, is 
positive-dimensional. If player i acts at the root i>, then for any edge e emerging 
from v, tjj(e) does not appear in any of the equations. 

All the monomials occurring in these equations are squarefree. For each leaf 
A under v, let the path from v to A be v = V\ . . . Uk = A. Then for any player 
j with pure strategy Sj, we have Pr[A|sj, = nf=i 1 -P r [^ — * W+ilsj, an d 
each nonconstant term in the product is a n (yi — > vi+i) for some player n ^ j. 
So for any edge e where n acts, the variable cr n (e) occurs at most once in such a 
product. In fact <r n (e) occurs in such a product for at most one e € E(v{). (That 
is, if e,e' 6 E{vi) then a n (e) and cr„(e') do not both occur in this monomial. So 
condition 2 of Theorem [1] holds.) When we eliminate a n (e nlJl ), we replace it by an 
affine expression, so this remains true. Thus condition 1 of Theorem [1] holds. 

The equations corresponding to E{v) — {e^} concern only the subgame below v, 
so <Jj([i — > k) occurs in these equations only if v is an ancestor of /i. Furthermore, if 
i acts at k below v, then (Tj(e) does not occur for any edge e € E(k) — {ei K }, since we 
fix that z chooses e^ K . For the same reason aj (e) does not occur for e € -E(m) — { e j>} 
for any /i that lies below k but not below e^ K . Thus condition 3 holds. □ 

Our result does not contradict Harsanyi's generic finiteness theorem [2], because 
generically, iterated elimination of weakly dominated strategics/backward induction 
will lead to a unique subgame perfect equilibrium (and so indeed there will be no 
totally mixed Nash equilibria). On the other hand, another way to look at our result 
is that in every interesting extensive-form game — one which is not completely solved 
by backward induction, giving a unique equilibrium — the set of totally mixed Nash 
equilibria is also interesting; it has positive dimension. 

In particular, if v is a node all of whose children are leaves, the equations cor- 
responding to v will be equations between constants, stating that for the player i 
who acts at v, the utilities iij(A) at all the leaves A below v must be equal. This is 
true if iterated elimination of strictly dominated pure strategies has already been 
performed on this game. 

It is clear that the system of equations we obtained is not canonical, since we 
have made arbitrary choices of the edges and the subtrees below each possible 
choice are different. Choosing a different system may make it easier to compute 
the set of quasiequilibria. 
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(0,0,1) (1,0,1) (3,6,1) 

Figure 3. An Extensive Form Game 

Wc now present an example where the set of totally mixed Nash equilibria is a 
positive-dimensional semialgebraic variety. Consider the extensive form game spec- 
ified in Figure[4] The polynomial graph associated with this game tree is depicted in 
Figure 3.4. For brevity, we write for example <Ji(C) for <ji(A — > C). The quasiequi- 
libria obey a system of 4 equations as in Theorem The equation associated with 
the edge E — > G equates the payoff to player 3 from choosing this edge with that 
from choosing the edge E — > F, i.e., 113(F) = 113(G). No variables occur in this 
equation, that is, it is an equation between constants. Similarly, the equation asso- 
ciated with the edge E — > H is u 3 (F) = 113(H). The equation associated with the 
edge C — * E is 112(D) = U2(E), where we have written 112(E) for the expected pay- 
off U2(E, 0-2) to player 2 for choosing the edge C E, given the strategy profile of 
the other players. In this case 112(E) = u 2 (F)a 3 (F) + U2(G)a 3 (G) + u 2 (H)a 3 (H), 
so 

u 2 (D) = u 2 (F) + (u 2 (G) - u 2 (F)) a 3 (G) + (u 2 (H) - u 2 (F)) a 3 (H). 
Finally, the equation associated to the edge A — > C is 
Ul (B) = Ul (C) 

= Ul (D) (1 - a 2 (E)) + Ul (F)a 2 (E) (1 - a 3 (G) - a 3 (H)) 
+u 1 (G)<j 2 (E)<j 3 (G) + Ul (H)a 2 (E)(j 3 (H). 
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Figure 4. Associated Polynomial Graph For An Extensive Form Game 



Looking at the specific payoffs in Figure 21 we see that the payoffs to player 3 
for choosing F, G, or H are equal, as required. Equating the payoffs to player 2 
for choosing D or E, we get &az(H) = 2, or crs(H) = i. This leaves 173(G) free to 
vary such that < (73(G) < |. Finally, we must equate the payoffs to player 1 for 
choosing B or G. This gives 

2(1 - a 2 {E)) + a 2 (E) (a 3 (G) + 1) = | 

or 

a 2 (E)(l-* 3 (G)) = ±. 

Thus the points (73(G) and (72(E) lie on a hyperbola. This hyperbola intersects 
the interior of the product of simplices. For instance, the point (73(G) = ^ (so 
(73(F) = j) and <t 2 (E) = | lies in this intersection. So the set of quasicquilibria is 
a portion of a hyperbolic cylinder, the product of a segment of a hyperbola with a 
line segment (since <Ji(B) varies freely with < c\{B) < 1). 

We can analyze this game a little further. Player 3 would like player 1 to some- 
times choose B, but cannot force player 1 always to choose B, since if player 2 
always chooses D then both player 1 and player 2 are better off with player 1 
choosing G. The best player 3 can do is make the payoffs to player 1 from choosing 
B and G equal. Now if player 3 made player 2 get a greater payoff from choosing D 
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than E, then player 2 would always choose D, player 1 would always choose C, and 
player 3 would get nothing. So player 3 must make U2(D) < U2{E). We analyzed 
the case U2(D) = 112(E) above. If player 3 makes (73(H) > |, then U2(D) < 112(E) 
and player 2 will always choose E. Then the payoff to player 1 from choosing C is 
a 3 (G)+3a 3 (H). Thus we have (73(G) +3cr 3 (H) = § with | < a 3 (H) < \ (this makes 

< cr 3 (G) < \ and \ < 03(F) < ±). Then 01(C) varies freely with < 01(C) < 1, 
so we have a rectangle of partially mixed equilibria. Player 3 is better off choosing 
these, since then the outcome D where player 3 gets zero payoff is never reached. 
Along the line cr 3 (G) + 3a 3 (H) = |, equilibria with greater o~ 3 (H) Pareto dominate 
those with smaller a 3 (H), i.e., they make some player better off and no player worse 
off. Specifically, the payoff to player 2 increases, the payoff to player 1 is always | , 
and the payoff to player 3 stays the same at 2(1 — 01(C)) + 01(C) — 2 — <ri(C). 
Thus the Pareto dominant equilibrium among those on this line is that player 3 has 
(73(F) = |, <r 3 (G) = 0, and 03(F) = \. On the other hand, at the pure strategy 
equilibrium where player 3 always chooses H , we have that player 1 always chooses 
C, and the payoff to player 3 falls from 2 — (7i(C) to 1. Thus player 3 does not 
prefer this equilibrium, and instead mixes F and H equally to have some chance 
of a higher payoff. As 01(C) increases, the payoff to player 3 decreases and the 
payoff to player 2 increases, so the equilibria along this line do not Pareto dominate 
each other. Thus without introducing other issues (such as risk-aversion) there is 
no criterion for predicting which of the equilibria along the line < 01(C) < 1, 
02(E) = 1, 03(F) = a 3 (H) = \ should be chosen. 

5. Games With Emergent Node Tree Structure 

So far we have been discussing normal form games with finite numbers of players, 
each with a finite number of pure strategies. Such a game is defined by giving a set 
of players I = {1, . . . , N}, for each player i a finite set of pure strategies Si, and for 
each pure strategy profile a (element of the product S = Yii£i &i) an d eacn player 

1 the utility Ui(a) received by that player when that strategy profile is played. Now 
we will introduce a particular kind of structure that a normal form game may have. 

We now define an emergent node tree structure on a normal form game. This 
is a new model for games in which the players can be hierarchically decomposed 
into groups. Usually such hierarchical decomposition is discussed in the framework 
of cooperative game theory. Instead, we define certain conditions on the payoff 
functions in a noncooperative game such that a given hierarchical decomposition 
"makes sense" , in a way that we will define precisely. At the end of this section we 
briefly describe how our framework relates to that of cooperative game theory. 

Definition. An emergent node tree structure on a normal form game with player 
I = {1, . . . ,N}, pure strategy sets Si for i el, and utility functions Ui : Yiiei ^ ~^ 
R to consist of: 

• A tree T with N leaves. The leaves are in bijection with the players I = 
{1, . . . , N}. Write C„ for the set of children of a node v £ T, B v for the set 
of its siblings, and f(v) for its parent. 

• For each non-leaf, non-root node v of the tree (which we call an emergent 
player), a set S v of pure strategies, with \S V \ < YiweC 

• For each non-leaf, non-root node v, for each element sc„ of the product 
Sc v = Yiwec of the pure strategies of its children and each element s v k 
of S v , a number p v (k,sc v ) signifying the probability that the (emergent) 



18 



RUCHIRA S. DATTA 



strategy of the emergent player v is s v k when the strategies of its children 
are given by sc v - So if v has K pure strategies, then ^2^ = iPv(k, Sc v ) = 1- 
If the children of v execute a mixed strategy, then the emergent mixed 
strategy of v is given by multilinearity. Thus we have defined a linear map 
from the strategy space of the children to the strategy space of the parent. 
We require that this map have full rank. 
• For each non-root node v (including the leaf nodes), real numbers y vw for 
each non-root ancestor w of v and real numbers U v (s) for each element 
s G S v x Jl^g^ S w . From these we define a utility function u v , which 
is a sum of two terms: U v {u v _b v ), a multilinear function of the strategies 
executed by v and its siblings in B v , and £ nonroot ancestors « 7<™ u w . We 
require that the utility function u v at a leaf node v be equal to the utility 
function Ui of the player i corresponding to the leaf node v. 

We will refer to an emergent node tree structure as an ENT for short. Note that 
for a given normal form game, we can always define a class of ENTs by defining 
a tree with a single emergent node (the root node), so that all the leaf nodes are 
siblings. We call such an ENT trivial. For any given normal form game, there need 
be no nontrivial ENT, or there may be many distinct possible ENTs. 

The behavior of the emergent players is completely determined by the behavior 
of the actual players (the leaf nodes). The emergent strategy a v executed by the 
emergent player v when the actual players execute strategy profile a is defined 
recursively by multilinearity: 

<Tv(Svk)= ^2 Pf( fc ' S ) ] [ a w(Sw)- 

ses c „ iuec„ 

So we compute the emergent strategics from the bottom up. 

From the above definition, we see that at a non-root node w of the tree, the 
utility function is 

(a) = U w (a w ) + 2J 

nonroot ancestor v 

= ^2 U w (s)a w (s w ) ] [ <7 x (s x )+ ^2 *y wv u v (a). 

s£S u) xY\ 3 , eB S x x£B w nonroot ancestor v 

So we compute the utility from the top down. 

We see that the utilities of each actual player (the leaf nodes) may depend on 
the strategies executed by every other actual player. So, the graphical model of 
the actual game may be the complete graph. Imposing an emergent node tree 
structure, corresponds to deleting some of these edges and adding more nodes, and 
edges connected to those nodes, to the graph, so that the new graph has a nontrivial 
structure. With the addition of the new variables a v {s v k), we get more information 
about the sparsity of our multilinear equations. 

In our definition, we did not require that the numbers j vw have the same sign 
for all descendants v of a node w. Thus, our definition does not require that 
the emergence of a node represent a common interest among its descendant nodes 
(although of course it does cover that situation). 

For example, consider a normal form game with the ENT in Figure [5] where the 
leaf nodes correspond to 

(1) An American citizen 
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American citizen Soviet saboteur Soviet citizen American saboteur 

Figure 5. Emergent Node Structure For The Saboteur Game 



(2) A Soviet saboteur living in America 

(3) A Soviet citizen 

(4) An American saboteur living in the USSR 

The parent of nodes 1 and 2 is node 5, corresponding to America, the parent of 
nodes 3 and 4 is node 6, corresponding to the USSR, and the the root is node 7, 
corresponding to the world. Then while 715 > and 7 36 > 0, we have 725 < and 
746 < 0. 

We now define a natural refinement of the equilibrium concept for games with 
an ENTs. 

Definition. If a normal form game has an ENT as defined above, then a Nash 
equilibrium a of that game is hierarchically perfect with respect to this ENT if for 
every emergent node v, given the strategies induced on the siblings of v by a, the 
payoff u(v) at v cannot be increased by changing only <t(v). 

Note that since our definition requires the linear map from the strategy space 
of the children of v to the strategy space of v to be full-rank, any strategy cr'(v) 
deviating from u{v) which could result in a higher payoff u(v) would be achievable 
by some strategy profile of the descendants of v. 

We will also need the following definition: 

Definition. A strategy profile of a normal form game with an ENT is totally 
mixed with respect to this ENT if it is totally mixed in the usual sense and the 
emergent strategies at each emergent node are also totally mixed. 
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Theorem 8. For a generic game with an ENT as above, construct a directed 
graphical model G whose nodes are the nodes of the tree except the root, with edges 
as follows: the children inT of a node v form a directed clique in G, and each such 
child also has a directed edge from v and each ancestor of v except the root, and from 
each of their siblings. Then the Bernstein number we obtain by applying Theorem 
to this directed graphical model is an upper bound on the number of totally mixed 
Nash equilibria of this game which are hierarchically perfect and totally mixed with 
respect to this ENT. 

Proof. This is the graphical model we would obtain if all the emergent players were 
actual players. That is, we have ignored the equations 

0~v{Svk) = 2J Pv{k,s) ] [ CT w {s w ). 

So the set of totally mixed Nash equilibria of our game which are hierarchically 
perfect with respect to this ENT is a subset of the set of totally mixed Nash 
equilibria of the game with this graphical model. □ 

Generically, there may be no hierarchically perfect totally mixed Nash equilibria. 
If the system of equations defining the quasiequilibria of the game with the directed 
graphical model is O-dimensional, then none of the finitely many solutions to this 
system may satisfy the additional equations 



crv(svk) = 



p v {k,s) ] [ a w (s w ). 



wEC v 



For example, consider a game as in Figure [5] in which each actual player has two 
pure strategies and each emergent player also has two pure strategies. Generically, 
a game with 4 players, each with 2 pure strategies, would have 

fO 1 1 1\ 

1 1 

1 1 
1 1 0/ 



per 



1 
1 

V 1 



= 9 



quasiequilibria. On the other hand, if the game has an ENT as in Figure then 
the directed graphical model given by the theorem is as in Figure Thus there is 
no more than 
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quasiequilibrium which is hierarchically perfect and totally mixed with respect to 
this ENT. Indeed this would hold whenever the ENT is a binary tree, that is, 
each non-leaf node has two children, and all siblings have the same number of pure 
strategies. 

For example, say that if players 1 and 2 either both choose their 0th pure strategy 
or both choose their 1st pure strategy, then the emergent strategy of node 5 is S51, 
otherwise it is s 50 - Similarly, if players 3 and 4 cither both choose their 0th pure 
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Figure 6. Graphical Model For The Saboteur Game 



strategy or both choose their 1st pure strategy, then the emergent strategy of node 
6 is S6i, otherwise it is sqq- Let U5 and C/@ be given by 



(2) 



S60 sqi 
s 50 (0,0 0,-1 
« B i \7,0 -5,1 J' 



(where the (i, j)th entry is the pair Usfai, sej), Ue(s5i, s^j)). Let 71 = 73 = 1 and 
72 = 74 = — 1- Let t/i and be given by 



(3) 

and let Us and L/4 be given by 



S20 s 2 i 
sio /0,0 0,-1' 
s u I 1,0 -4,1/' 



(4) 



s 30 
S31 



S40 

0,0 

1,0 



S41 

0,-1 

-3,2 



We abbreviate Cj(sji) as cr^ by abuse of notation. At a totally mixed Nash equilib- 
rium a which is hierarchically perfect and totally mixed with respect to the ENT 
of Figurc[51 we have = U 5 (s 50 , cr 6 ) = U 5 (s 5 i, a 6 ) = 7(1 - cr 6 ) - 5er 6 = 7- 12er 6 , so 
(Jq = j^. Similarly we have = — (1 — 05) + 05 = 2a§ — 1 so 05 = -. 

We also have iti(sio, 02, 05, 06) = C^i(sio s 02) + ^5(05, erg), which we must equate 
to ui(sn, o"2, (T5, ere) = J7i(sn,o"2) + 1*5(175, ae), for hierarchical perfection (here 
we are ignoring the fact that 05 is a function of a\ and 02). This gives us that 
= J7i(sio,<72) = £7i(sii,<72) = (1 — 02) — 4ct 2 = 1 — 5(72, so CT2 = \. Similarly 
we have 1*2(320, fi, 05, o^) = ^2(^20, 01) — 1*5(05, 06), which we must equate to 
u 2 (s2i,cri,a 5 ,ae) = U 2 (s 2 i, <Ji) -u 5 (<r 5 ,a 6 ), so (7 2 (s 2 o,0i) = t/ 2 (s 2 i, 01). This gives 
= —(1 — (7i) + (7i = 2cri — 1, so t7i = i . We also have = (1 — (74) — 3(74 = 1 — 4<74, 
so (74 = j, and = —(1 — cr 3 ) + 2er 3 = 3(7 3 — 1, so cr 3 = 3. 

Finally, we check that <7i<72 + (1 — (7i)(l — <7 2 ) = + y|y = \ = (75, and 
(7 3 (74 + (l — (7 3 )(1 — (74) = Y2+^ = J2 — °"6- Now given er_i, player 1 cannot increase 
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either U\ or U5 by changing only o\, so player 1 cannot increase u\. Similarly, player 
2 can neither increase U\ nor decrease 115 by changing only 02, so player 2 cannot 
increase ui- In this way, we see that a is a Nash equilibrium of the actual game. 

A strategy profile of the actual players is a point in the product of probability 
simplices corresponding to their actual strategy spaces. When we pass to an emer- 
gent player one level up, we project the product of simplices for the actual players 
below that emergent player to a smaller dimensional simplex, the space of emergent 
mixed strategies of this emergent player. That we are able to do this means that 
the payoffs to other actual players, not below this emergent player, depend only on 
the choice of a point in the smaller dimensional simplex by these actual players. 

We can use ENTs to analyze certain cooperative games. We consider each coali- 
tion to be an emergent player. An actual player's pure strategies specify the highest 
level of coalition to join. So the number of its pure strategies is the number of its 
ancestors in the tree(including itself). Each coalition forms if all its descendants 
agree to join it, otherwise it doesn't form. The number of pure strategies of a 
coalition is one more than the number of its ancestors (including itself). Its pure 
strategies correspond cither to the highest level of coalition containing this coali- 
tion which its members have agreed to form, or to not forming this coalition itself. 
The function U v for each coalition v is zero if the coalition forms and is equal to 
the value of the coalition if it does form; it does not depend on the actions of u's 
siblings. The number j vw represents w's share of the gain from the larger coalition 
w, if it forms. 

Note that a given ENT does not allow all possible subsets of players to form 
coalitions, but only certain ones. We could extend the definition to all possible 
subsets by positing that for any partition of a coalition into subcoalitions not in 
the tree, the subcoalitions receives the same utility by joining or not joining the 
coalition. Thus not all cooperative games correspond to ENTs. Those that do, 
however, may often occur in modeling real situations. 
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